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Abstract. We study a nonequilibrium Langevin many-body system containing 
two 'test' particles and many 'background' particles. The test particles are 
spatially confined by a harmonic potential, and the background particles are 
driven by an external driving force. Employing numerical simulations of the 
model, we formulate an effective description of the two test particles in a 
nonequilibrium steady state. In particular, we investigate several different 
definitions of the effective force acting between the test particles. We find that 
the law of action and reaction does not hold for the total mechanical force exerted 
by the background particles, but that it does hold for the thermodynamic force 
defined operationally on the basis of an idea used to extend the first law of 
thermodynamics to nonequilibrium steady states. 
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1. Introduction 

Colloids are microscopic particles suspended in liquid. Generally, they are on the order 
of micrometers in size, and thus they are much larger than molecules, but still small 
enough to exhibit Brownian motion. Colloids are convenient to study experimentally 
because unlike molecules, they can be easily observed with ordinary microscopes. In 
recent years, as the technology used in their manipulation has developed, experimental 
studies of colloids have advanced greatly [1, 2, 3, 4, 5, 6]. 

In colloidal many-body systems, melting, freezing, glass transitions and 
nonequilibrium statistical mechanics have been studied. Among studies of 
nonequilibrium steady states (NESSs), Dzubeilla et al. investigated a model that 
describes two fixed colloidal particles (test particles) in an environment containing 
many driven particles (background particles). They reported that in a NESS, the 
effective interaction forces they defined between the two fixed particles violate the law 
of action and reaction [7]. This result implies that an effective potential seems not to 
be constructed in NESS. 

The effective interaction force defined in Rcf. [7] represents the two-body effect of 
the total force exerted by the background particles, which is extracted by subtracting 
from it the total force in the case that there is only colloidal particle. Although their 
definition seems plausible because of its simplicity, we expect that there is room to 
define a different type of effective force in NESS. With this motivation, we attempt to 
provide another idea for an effective interaction force between the two fixed particles. 

In this paper, we reconsider effective forces in NESSs by studying a system similar 
to that used in Ref [7]. First, we review the concept of effective forces in equilibrium 
from three points of view, statistical mechanics, mechanics, and thermodynamics. 
Next, we investigate effective forces for nonequilibrium systems by considering the 
results of numerical experiments. Particularly, we demonstrate that in the NESS we 
consider, the law of action and reaction holds for the effective force defined according 
to a conjectured thermodynamic relation applied to NESSs. 

2. Model 

The model we study describes a system in which two 'test' particles are trapped side by 
side in the center of the system by a harmonic potential and N 'background' particles 
are driven by an external force (see Fig. 1). The test particles are unaffected by the 
driving force, and the background particles are unaffected by the trapping potential. 
Hereafter, we refer to the test particles as particle 1 and particle 2. 

For the sake of simplicity, we consider the idealized situation of a two-dimensional 
system of length and Ly in the x and the y directions, with periodic boundary 
conditions in both the directions. Then, letting .Ri and R2 be the positions of particle 
1 and particle 2, we consider particle 2 fixed for simplicity, with particle 1 trapped 
by the harmonic potential 

Vt{Ri) = ^{R,-R.f, (1) 

where Rc corresponds to the center of the potential, and A; is a spring constant 
chosen to be sufficiently large that particle 1 can be regarded as almost fixed. It is 
important to note that, although it may seem simpler to fix particle 1, the dynamical 
degrees of freedom of particle 1 must be taken into account when we consider the 
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Figure 1. Schematic representation of the model we study. Remark that the 
background particles are not driven in the equilibrium case. 



distribution function of the effective description in which the degrees of freedom of 
the background particles are integrated. [If particle 1 is also fixed, no variable remains 
in the distribution function of the effective description (see the next section)]. As a 
further simplification, it is assumed that there is no direct interaction between particles 
1 and 2 and that there is no direct interaction among the background particles. Then, 
we stipulate that the interaction between particle 1 or particle 2 and a background 
particle is represented by a short-ranged potential function Vint(^i ^ ^k), where fk is 
the position of the fc-th background particle (fc = 1, • • ■ , N), of the form 



Vint{r) = Vbexp 





r 


2" 


-2 








a 





(2) 



With the system as described above, the motion of particle 1 is described by the 
Langevin equation 



7i?i = -fc(i?i - i?c) - 



k=l 



rk) 



(3) 



dRi 

{£,x{t), ^y{t)) represents Gaussian white noise 



where 7 is a friction constant, and ^(t) 
that satisfies 

i^a (i)Ca' it'))= 2-,T6{t - • (4) 

Here, the Boltzmann constant is set to unity, and T {— 1//3) is the temperature of the 
environment. The motion of the fc-th background particle is described by 



in. = / - X! ■ 



aw, 



(5) 



where / = (/, 0) is an external driving force, and ^(i) = i£,k,x{t),^k,y{t)) is Gaussian 
white noise that satisfies 

= - t')5a,a'. (6) 

Below, all the quantities are converted into dimensionless forms by normalizing 
cr, 7 and T to unity. We set the parameters used for our numerical experiments as 
= 11, Ly = 6,N = 200, fc = 50, Vb = 7, < / < 0.3, = (3,3) and R2 = (4.5,3). 
Also, all the numerical results in this paper is obtained by a finite difference method 
of the Langevin equations with a time step 2.5 x lO"**. 
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3. Equilibrium case 

3.1. Review of the effective description 

Before analyzing nonequilibrium cases, we review the effective description of particles 
1 and 2 in equilibrium, in which the stationary distribution function of the model is 
the canonical distribution 

where Z is a normalization constant. In the equilibrium case, employing the well- 
established framework of statistical mechanics, we can derive the effective Hamiltonian 
of particles 1 and 2 by integrating (7) over the degrees of freedom of the background 
particles. 

For the canonical distribution Pc(^i, {"5=}; ^2) given by (7) and the interaction 
given by (2), there exists a function ^1 — R2, which we write Ves{Ri — R2), satisfying 
the equation 

N 

exp{-^[V;ff - R2) + Vt{Ri)]} = / n dfkPc{Ru{rk}; R2). (8) 

fe=i 

It is natural to refer to the function Ves{Ri — R2) as the effective interaction 
potential. The fact that this effective interaction potential depends on only the relative 
displacement ^1 — R2 is due to the the spatial symmetry of the system. Then, as the 
left-hand side of (8) depends on only .Ri and R2, it is interpreted as the steady state 
distribution for the effective description: 

Peff(4;^2) = eM-P[Vt{Rl) + Veff(i?l - R2)]}. (9) 

Clearly the effective potential Vcs{Ri — R2) obtained in the above manner is properly 
defined, as this Pefi(fii; ^2) is in canonical form. 

With the above argument establishing the proper definition of Ves{Ri — R2), the 
statistical mechanical force between particles 1 and 2 is defined naturally by 

dRi 

with i = 1,2. Because Vcs{Ri —R2) is a function of the relative displacement R1 — R2, 
we immediately find the relation 

which represents the law of action and reaction for statistical mechanical forces in 
equilibrium. The statistical mechanical force defined above is closely related to the 
mechanical force exerted by all the background particles, 

f?mec _ 9Vint{Ri - fk) „x 

' — — ■ ^ ^ 

k—l 

Indeed, using (8) and (10), we can prove the relation 

Tistat 
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Figure 2. (a) Simple operation shifting the position of particle 2 as R2 — » 
R2 + A_R2 instantaneously at time t = 0. Remark that the background particles 
are not driven in the equilibrium case. 

(b) Simple operation in which the roles of particles 1 and 2 in (a) are exchanged. 



where ( represents the statistical average in the steady state with / = (see 
Subsection 3.1 for the proof of (13)). From (11) and (13), we obtain the law of action 
and reaction for FJ^°'^; 

The statistical mechanical force in equilibrium can also be understood within a 
thermodynamic framework by considering the case in which an operation is performed 
on the system. We now explain this understanding. As an example, we consider 
the simple operation of shifting the position of particle 2 as i?2 R2 + Ai?2 
instantaneously at time t — 0. (See Fig. 2 (a) depicting the case / = 0.) After 
the application of this operation, the system is left until a new equilibrium state is 
realized. Then, the work done by the external agent carrying out this operation, M^°p^, 
satisfies the first law of thermodynamics: 



w 



f=o 



N 



+ (^^AV^„t(i?^-rl) 



= 1 k=l 



opl 



/=0 



(15) 



Here ( represents the statistical average with respect to this operation. The 
quantities Qi and Qb are the energies transfered to the heat bath from the degrees 
of freedom of particle 1 and the background particles. We refer to each of these 
transferred quantities of energy as heat. According to Ref. [8] , the quantities 



Ji 
Jb 



(jRi-t) °Ri, 



N 
k=l 



(16) 
(17) 



represent the heat transferred per the unit time, and therefore Qi and Qb can be 
defined as 



dtJi{t), 
dtJb{t). 



(18) 
(19) 
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The symbol o in (16) and (17) indicates that the product here is the stochastic Stieltjes 
integral in the Stratonovich sense [8]. 

Now, using the work, W°'^^, we define the thermodynamic force by 

pthermo= jj^^ 11^ . (20) 

Then, integrating the Langevin equations (3) and (5), and using the expression 

i?2 = Ai?2(5(t) (21) 
to represent the operation, we can prove the relation 

^thermo ^ (^F^<''')\ ^ , (22) 



//=o' 



(see Subsection 3.2 for the proof of (22)). 

In the same manner that we defined the thermodynamic force p^^^™°^ we can 
also define i?tii°""o by exchanging the roles of particles 1 and 2. (See Fig. 2 (b) 
depicting the case / = 0.) That is, particle 1 is fixed, while particle 2 is trapped by 
the harmonic potential. Because this exchange is equivalent to the spatial reflection 
with respect to .R2/2, we find 

^thermo ^thermo (23) 

Then, from (14), (22) and (23), we derive 

^thermo /^mec\^ (24) 



\ ' //=o 

From the above results, wc conclude that in the equilibrium case, because 
Ff^^^^ = (^F^'^'^^ = we can regard any one of these quantities as 

the effective interaction force between particles 1 and 2. 

3.2. Proofs of (13) and (22) 

Proof of (13): The differentiation of (8) with respect to R2 yields 

gFeff(J?i-fi2) exp{_^[y^g(^^ _ + V,{R^)]) 

dR2 

n drl J2 ^M^pltlp^^R,,f,; 4). (25) 

k=i k=i 



I 



Integrating this with respect to Ri , we derive 



' dV,s{Ri ~ R2) \ ^ /y^ 9Mnt(4-rfc) \ 
. 1,^, \h dR2 



/=o 



Using the definitions (10) and (12), we obtain (13). 
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Proof of (22): From (3) and (5) with / = 0, we obtain the energy balance equations: 
(ir-fe -Cfc(i)) orfc = — orfe, (29) 

i=l 

where k = l,---,N. The addition of (28) and (29) with k = l,---,N leads to 

2 AT 
i=l fc=l 

fc=l <^-^2 

where we have used (21). Here, we perform the time integration and consider its the 
statistical average. Noting that the third term of the right hand side of (30) becomes 

- (f^'"'\ ■ Ai?2, we obtain 
\ //=o 

2 JV \ °Pl 

\ opl 



+ ( E E A^nt(^i - Tk) ) + {AVtiRl)) ^ . (31) 



= 1 k=l 



Comparing this with the definition of F2 given in (15), we obtain 



F, =(^F, J^^^. (32) 



4. Nonequilibrium case 

In this section, which consists of three subsections, we study the nonequilibrium case. 
We first note that the canonical distribution cannot be employed in the derivation of 
an effective description for a NESS, in contrast to the equilibrium case. In the case 
of NESSs, the relations among Ff '^'^, pmcc ^^^^ ^thermo ^^^^ understood. In 

this section, we investigate these three forces as defined above in the nonequilibrium, 
f ^ case. Wc hope that this will allow us to obtain the proper effective description 
of particles 1 and 2 in a NESS. We first present the numerically computed results 
determining i^^^'^'^ and i^th°™° as defined in (12) and (20) for a NESS. Then, we 
derive Ff^''^^ from the expression of the steady state distribution and compare this 
i^f ^' with '^'^ and F/*^"'"". 

Throughout this section, we consider only the case of forces in the x direction 

and denote the X component of F[^'"=, j;thermo ^stat j^mec^ j^thermo g^^^ j^stat 



4.1. Mechanical forces exerted by the background particles 

In Fig. 3, (Ff and - {F^^'')^f are plotted as functions of /. In the case / = 0, 

it is seen that (F'™'"^)^.^q — {F^^^y^-^Q, which is consistent with (14). However, it 
is seen that for / ^ 0, these quantities are not equal, and indeed the discrepancy 
between them increases monotonically as a function of /. Hence, the law of action 
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Figure 3. {F™'^'^)^, (open symbols) and — (F™°'^)^ (solid symbols) are plotted as 
functions of /. 



and relation does not hold with respect to (-F'l"'"^)^ and (-F™'"^)^ in the nonequilibrium 
case, unlike in the equilibrium case. This asymmetry is interpreted as follows. Particle 
2 is partially shielded from the effect of the background particles by particle 1 in the 
case / > (see Fig. 1). 

4-2. Thermodynamic definition 

Let us now reconsider the first law of thermodynamics represented by (15), which 
provides the definition of i^thormo j-^ _ 1,2). In contrast to equilibrium cases, (15) 
cannot be employed directly for NESSs, because J^, defined by (17), takes a nonzero 
value even when there is no operation applied to the system, and hence Qh becomes 
infinite. (Recall that the background particles are driven by the external driving force, 
/• ) 

In order to extend thermodynamic considerations to NESSs, we introduce the 

idea of the net heat generated by an operation, following the framework of steady state 
thermodynamics proposed by Oono and Paniconi [9]. In this framework, the heat 
necessary to maintain a steady state (the so-called house keeping heat) is regarded as 
being independent of the change undergone by the system caused by the operation, 
and the excess heat is defined by subtracting the house-keeping heat from the total heat 
dissipated to the heat bath. They conjecture that thermodynamics can be extended 
to NESSs by using this excess heat. 

Here, as one example, in Fig. 4, {J]-,{t))y^ is plotted as a function of time in the 

case that AR2 = (Ai?2,0) = (0.25,0) and / = 0.3. This graph shows that {Jh{t))°/^ 
reaches a steady state value, Jb(c!o), sufficiently long time after the application of the 
operation. Then, employing the idea of the excess heat, it is reasonable to define 

POO 

Qb= dt{Mt) - Moo)). (33) 
Jo 

By replacing Qb in (15) with Qb, we hypothesize the following an extended form of 
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0.2 0.25 



Figure 4. {Jh(t))°f'^ (open symbols) and (Jb(i))y^^ (solid symbols) as functions 
of time t in the nonequilibrium case with / = 0.3. Here, AR2 = 0.25 and 

ARi =0.25. <Jb(t)>7^ and (Mt))"/'^ 

are computed in the situations described 

in Figs. 2 (a) and (b), respectively. 



the first law of thermodynamics: 

opl / y opl 



TV 



opl 



^^AV^„t(^i-ffc)) . (34) 



U=l k=l 



Using this W"^^, we define the thermodynamic force in the present NESS by (20). 
In Figs. 5 and 6, we plot (AVt)/'^ and <^I]Li I^feLi AMnt(^i - Hc)^^ as 

functions of AR2 in the case / = 0.3. It is seen that these quantities depend linearly 

on Ai?2 in the range plotted. This implies that Ai?2 = 0.25 is sufficiently small 
to bo used in (20) to numerically compute the force. Using this value, we obtain 

°Pl /.__,^,\°Pl /_2 AT . . . \ °pi 



Qh)^ = 0.61, {^AVtiRi))^ = -0.11, {Et=iELi ^Vint{R^ - Tk)) ^, = 0.79. 

Also, we find that {Qi)Y^ is sufficiently small to be ignored (within the numerical 
accuracy of our simulations). Using these values, we estimate 

jjrthermo ^ _^ 2. (35) 

Next, by exchanging the roles of particles 1 and 2 (see Fig. 2 (b)), we can define 
pthermo ^j^g Same way: 

- ^™°Ai?i = (Q2)7' + (Qb) J' + (AVt(^2)) J' 
+ (5^5^Ayi„t(^i-rfe)\ +0(Ai?2). (36) 
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Figure 5. (AVt>7^ ^ ^ function of A_R2, and (AVt>7^ as a function of A_Ri 



op 2 



The open symbols and the solid symbols represent the quantities obtained in the 
situations described in Figs. 2 (a) and (b), respectively. 



op2 



In Figs. 5 and 6, we plot {AV't)"^'^ and (^Yh=i J2k=i ^^nt(-Ri — ^'^^/y. ^ functions 
of Ai?i in the case / = 0.3. Also, in Fig. 4, {Mt))"/^ is plotted as a function of time 

_ \ op2 / ^ op2 



in the case Ai?i = 0.25. Then, obtaining {^QbJ = 0.64, {^AVt{Ri)j = -0.05, 

2 N ^ ^ \ 

AVint(-Ri — nc)y^ = 0.79, and ignoring the small contribution from 

{Q2)°f'^ , we estimate 

^thermo ^ 5 5^ (37) 

The numerical results given in (35) and (37) are consistent with the law of action 

and reaction with respect to ^T'thormo ^thormo_ w^yje jg desirable to obtain 
more precise rcsiilts [The uncertainty on the values of ^'hermo jg mainly to the 

difficulty in determining (^Qhj and (^Qhj (see Fig. 4).], it is clear from the 

present results that even if the law of action and reaction is violated for _pthermo 
the NESS we consider, the extent of this violation is much less than that in the case 
of Fr^"" [recall that we found {F^'"')^j, = 7.0 while {F^"")) = -3.6 (see Fig. 3)]. 



4.3. Statistical mechanical definition 

In this subsection, we investigate the interaction force between particles 1 and 2 

in a NESS from a statistical mechanical point of view, employing the steady state 
distribution function, Ps{Ri, {rk}; -^2)- It is known that Ps(i?i, {rk}: R2) is given by 

p,(i?i,K};i?2) = lim pc(i?i,{rfe};i?2)exp(-/3SO, (38) 

r— s-cso 

with 



Jo 



N 

dt^f-fk, 

k=l 



(39) 
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where A denotes the statistical average of A over noise histories under the condition 

that the initial condition (i?i(0), {rk(0)}) is fixed as the argument (i?i, {rk}) of the 
distribution function ps(_Ri, {rk}', Ri)- The expression (38) indicates that the deviation 
of Ps(^i, {Hc}; ^2) from the canonical distribution, pc{Ri, {rk}] R2), is represented by 
the entropy production /3St- This form of the steady state distribution is similar 
to that obtained by Zubarev and McLennan [10, 11]. (Regarding the derivation for 
stochastic systems, see Subsection 4.2 of Ref. [12].) 

Now, referring to the equilibrium case, we define an effective potential Ves{Ri', R2) 

by 

exp[-/3(Feff(i?i;i?2) + H(i?i))] 
= lim T\dfkPc{Ri,{rk};R2)exp{-f3^r)- (40) 

k=l 

With this effective potential, we define the statistical mechanical force as 

^stat ^ _dVMEllM (41) 

Then, differentiating (40) with respect to R2, assuming that the relation 

d , , ^/ d 



5i?2 \dR: 

holds, we derive 

Tistat \ s 



exp(-/?SO = -P -^Er exp(-/3S^) (42) 



{^2 )f = {^2 )f 

r ^ g 

- lim dRiUdrk Ps{Ri,{rk};R2) — ^r. (43) 
kJ[ dR2 

Note that (42) is valid to linear order in / because the both hand sides of (42) become 

-/3-ls; + 0(l/T). (44) 

0H2 

We expect that (42) might be approximately valid even for large /, due to many-body 
effects. In the argument below, we assume (42). 

On the other hand, using the energy balance equation obtained from the Langevin 
equations (3) and (5), we can rewrite (34) as 

opl 



lim 

r— >oo 



Then, recalling that {)Y is the statistical average with respect to the instantaneous 
shift R2 ^ R2 + A.R2 at t = 0, we can write 



= dRiYl drk p^{Ri,{rk}; i?2)-^ / dt V ffcAi?2 
J k=i 9R2J0 fc^i 

+ 0(lAi?2|'). (46) 
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Figure 6. 

(E?=i ELi AMnt(«» - rk)) ' as a function of ARi. The open symbols and 

the solid symbols represent the quantities obtained in the situations described in 
Figs. 2 (a) and (b), respectively. 



Substituting this result into (45) and comparing the obtained expression with (43), 
we find 

^thermo ^ ^ir|tat^s _ ^^^^ 

Thus, the equahty Fl"^^™" = -F^'^^™° observed numerically in the last 
subsection suggests that Ff*** defined by 



dV^s{R2;Ri) 
dRi 



(48) 



_^stat 



(49) 

(50) 



satisfies the relation 

^stat 

We further assume that 

Ves{Ri;R2) = Ves{R2;Ri). 
Then, (49) and (50) imply that there exists a function Ves{Ri — R2) such that 

V^s{Ri - R2) = V^s{Ri;R2) 

= V^s{R2;Ri). (51) 
It is a future problem to develop a theoretical argument for the suggestion (49). 



5. Discussion 

In this paper, wc have studied three types of force, F^^'^^ , F™'^" and F^^'^™", in a NESS. 
In equilibrium, these forces satisfy the relations (^7*^*)j=o ~ (-^j™'^'^)/=o = F^*^**™". 
From the results of our numerical simulations, we found that in the NESS that 
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we study, i^thermo ^ „^thormo {F^'"')''^. ^ - {F^'^'^f , and hence the law of 
action and reaction holds for forces of the former kind but not the latter kind. We 
also demonstrated that i^^thermo (jgfined with respect to a form of the first law of 
thermodynamics hypothesized to hold for our NESS is equal to derived from 

the expression for the steady state distribution under the assumption represented by 
(42). 

The law of action and reaction holds for any force given by the derivative 
of a potential function. Thus, the fact that this law holds with respect to the 
thermodynamic force defined by (34) implies that in the NESS we considered, there 
may exist a potential function associated with this force. It is important to clarify the 
physical conditions under which the thermodynamic force obtained using the method 
employed in this paper indeed is a potential force. 

In equilibrium, a potential function is related to the thermodynamic free energy. 
For this reason, it is natural to conjecture that even in a NESS, the potential force 
measured experimentally is related to to thermodynamics. Such a conjecture led us 
to introduce the thermodynamic force based on the idea of Oono and Paniconi [9]. 
Here wc remark that the framework proposed by Oono and Paniconi is embodied 
in the nonequilibrium Langevin model [13]. In that work, Hatano and Sasa derived 
an identity which yields an extended second law relating the Shannon entropy with 
the excess heat they defined. Recently, the validity of this identity was confirmed 
experimentally for a bead system [14]. In the analysis employed in the present 
paper, we conjecture that Qb defined in (33) has a certain connection with the excess 
heat defined in Ref. [13]. However, we do not yet imderstand this relation, though 
apparently the quantity Qb employed here takes a simpler form than that proposed 
by Hatano and Sasa. 

As another important subject related to the present work, we now consider the 
problem of force decomposition. As seen in Subsection 4.1 (see Fig. 3), the law of 
action and reaction does not hold for the total mechanical force acting on the test 

particle, If the potential force in a NESS can be defined properly on the 

basis of thermodynamic considerations, it might be possible to decompose (-F™ '*'^) j into 
its potential and non-potential parts. Furthermore, because F™'^'^ fluctuates in time, 
we would like to decompose F™^'' into a fluctuating dissipative force, a fluctuating 
interaction potential force and the remaining part. 

With regard to the decomposition of fluctuating forces, recently, a significant 
result has been obtained for a model of a Brownian particle that is driven by an 
external driving force and subject to a spatially periodic potential. As this particle is 
driven in one direction, it experiences repeated 'collisions' with the periodic potential 
barriers. Studying a finite time average of the force exerted by the periodic potential 
under nonequilibrium conditions, we have found that a simple orthogonality condition 
provides a proper force decomposition of the time averaged force into a dissipative force 
and a non-dissipative part [15]. This result has led us to construct a mathematical 
technique for re-expressing a Langevin equation in a form in which the response 
function appears explicitly [16]. Using this technique, an interesting equality that 
connects energy dissipation with the violation of a fluctuation-response relation has 
been proved [17]. Considering these developments, the problem of decomposing 

F^^'^'^ can be regarded as a natural extension of the study presented in Ref. [15], 
involving the elimination of the dynamical degrees of freedom. 
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To summarize the most important point of this work, we have found that the law 
of action and reaction with respect to thermodynamic forces has a deep connection 
with fundamental aspects of nonequilibrium statistical mechanics. We believe that 
the numerical findings reported in this paper will stimulate further theoretical and 
experimental studies. 
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